Search

In real-world conversations, the diversity and ambiguity of stickers often lead to varied interpretations based on the context, necessitating the requirement for comprehensively understanding stickers and supporting multi-tagging. To address this challenge, we introduce StickerTAG, the first multi-tag sticker dataset comprising a collected tag set with 461 tags and 13,571 sticker-tag pairs, designed to provide a deeper understanding of stickers. Recognizing multiple tags for stickers becomes particularly challenging due to sticker tags usually are fine-grained attribute aware. Hence, we propose an Attentive Attribute-oriented Prompt Learning method, ie, Att$^2$PL, to capture informative features of stickers in a fine-grained manner to better differentiate tags. Specifically, we first apply an Attribute-oriented Description Generation (ADG) module to obtain the description for stickers from four attributes. Then, a Local Re-attention (LoR) module is designed to perceive the importance of local information. Finally, we use prompt learning to guide the recognition process and adopt confidence penalty optimization to penalize the confident output distribution. Extensive experiments show that our method achieves encouraging results for all commonly used metrics.

Using stickers in online chatting is very prevalent on social media platforms, where the stickers used in the conversation can express someone's intention/emotion/attitude in a vivid, tactful, and intuitive way. Existing sticker retrieval research typically retrieves stickers based on context and the current utterance delivered by the user. That is, the stickers serve as a supplement to the current utterance. However, in the real-world scenario, using stickers to express what we want to say rather than as a supplement to our words only is also important. Therefore, in this paper, we create a new dataset for sticker retrieval in conversation, called StickerInt, where stickers are used to reply to previous conversations or supplement our words. Based on the created dataset, we present a simple yet effective framework for sticker retrieval in conversation based on the learning of intention and the cross-modal relationships between conversation context and stickers, coined as \textbf{Int-RA}. Specifically, we first devise a knowledge-enhanced intention predictor to introduce the intention information into the conversation representations. Subsequently, a relation-aware sticker selector is devised to retrieve the response sticker via cross-modal relationships. Extensive experiments on the created dataset show that the proposed model achieves state-of-the-art performance in sticker retrieval.

Multi-modal intent detection aims to utilize various modalities to understand the user's intentions, which is essential for the deployment of dialogue systems in real-world scenarios. The two core challenges for multi-modal intent detection are (1) how to effectively align and fuse different features of modalities and (2) the limited labeled multi-modal intent training data. In this work, we introduce a shallow-to-deep interaction framework with data augmentation (SDIF-DA) to address the above challenges. Firstly, SDIF-DA leverages a shallow-to-deep interaction module to progressively and effectively align and fuse features across text, video, and audio modalities. Secondly, we propose a ChatGPT-based data augmentation approach to automatically augment sufficient training data. Experimental results demonstrate that SDIF-DA can effectively align and fuse multi-modal features by achieving state-of-the-art performance. In addition, extensive analyses show that the introduced data augmentation approach can successfully distill knowledge from the large language model., Comment: Accepted by ICASSP 2024

We have investigated the angle-resolved ATI spectrum of oriented molecules in the IR+XUV co-rotating circular laser fields. According to the different roles of IR and XUV laser in the ionization process, we purposefully adjust the photon energy of XUV and the intensity of IR laser to make the ionization spectrum of the molecule distributed in a suitable momentum region. Moreover, under the same laser conditions, the background fringes in the ionization spectrum of the molecule can be removed by using the ionization spectrum of the atom with the same ionization energy as the molecule, so that the molecular orbital density distribution in the suitable momentum region can be obtained. That is, for any unknown molecule, as long as the ionization energy of the molecule can be measured, the density distribution of the molecular orbital can be imaged in a definite momentum region by adjusting the laser field conditions, which may shed light on the experimental detection of molecular orbitals.

Space weather is a multidisciplinary research area connecting scientists from across heliophysics domains seeking a coherent understanding of our space environment that can also serve modern life and society's needs. COSPAR's ISWAT (International Space Weather Action Teams) 'clusters' focus attention on different areas of space weather study while ensuring the coupled system is broadly addressed via regular communications and interactions. The ISWAT cluster "H3: Radiation Environment in the Heliosphere" (https://www.iswat-cospar.org/h3) has been working to provide a scientific platform to understand, characterize and predict the energetic particle radiation in the heliosphere with the practical goal of mitigating radiation risks associated with areospace activities, satellite industry and human space explorations. In particular, present approaches help us understand the physical phenomena at large, optimizing the output of multi-viewpoint observations and pushing current models to their limits. In this paper, we review the scientific aspects of the radiation environment in the heliosphere covering four different radiation types: Solar Energetic Particles (SEPs), Ground Level Enhancement (GLE, a type of SEP events with energies high enough to trigger the enhancement of ground-level detectors), Galactic Cosmic Rays (GCRs) and Anomalous Cosmic Rays (ACRs). We focus on related advances in the research community in the past 10-20 years and what we still lack in terms of understanding and predictive capabilities. Finally we also consider some recommendations related to the improvement of both observational and modeling capabilities in the field of space radiation environment.

Few-shot and zero-shot entity linking focus on the tail and emerging entities, which are more challenging but closer to real-world scenarios. The mainstream method is the ''retrieve and rerank'' two-stage framework. In this paper, we propose a coarse-to-fine lexicon-based retriever to retrieve entity candidates in an effective manner, which operates in two layers. The first layer retrieves coarse-grained candidates by leveraging entity names, while the second layer narrows down the search to fine-grained candidates within the coarse-grained ones. In addition, this second layer utilizes entity descriptions to effectively disambiguate tail or new entities that share names with existing popular entities. Experimental results indicate that our approach can obtain superior performance without requiring extensive finetuning in the retrieval stage. Notably, our approach ranks the 1st in NLPCC 2023 Shared Task 6 on Chinese Few-shot and Zero-shot Entity Linking., Comment: Accepted to NLPCC2023